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On the Capacity of Multiple Access Channels with 
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Abstract — In this paper, the multiple access channel (MAC) 
with channel state is analyzed in a scenario where a) the channel 
state is known non-causally to the transmitters and b) there is 
perfect causal feedback from the receiver to the transmitters. An 
achievable region and an outer bound are found for a discrete 
memoryless MAC that extend existing results, bringing together 
ideas from the two separate domains of MAC with state and 
MAC with feedback. Although this achievable region does not 
match the outer bound in general, special cases where they meet 
are identified. 

In the case of a Gaussian MAC, a specialized achievable region 
is found by using a combination of dirty paper coding and a 
generalization of the Schalkwijk-Kailath [1], Ozarow [2] and 
Merhav-Weissman [3] schemes, and this region is found to be 
capacity achieving. Specifically, it is shown that additive Gaussian 
interference that is known non-causally to the transmitter causes 
no loss in capacity for the Gaussian MAC with feedback. 

Index Terms — Network information theory, multiple access 
channel, dirty-paper coding, feedback capacity, Gel'fand-Pinsker 
coding 



I. Introduction 

The capacity of channels with perfect feedback [4]-[7] is 
of great interest, as it provides us with an outer limit on 
the performance of any feedback-based scheme. Although the 
capacity of single user memoryless channels is unaffected 
by feedback [8], that of multiple access channels (MAC) is 
known to be enhanced by feedback from the receiver to both 
transmitters [2]. In the two-user Gaussian MAC case, the 
entire capacity region can be found in closed form employing 
Ozarow's ingenious extension [2] of the Schalkwijk-Kailath 
(SK) coding scheme [1] that enables limited cooperation 
between transmitters by using the feedback information. 

On a parallel track, the capacity of channels with state 
has been studied under a varied set of assumptions on state 
knowledge [9]— [ 11]. An important result in this family is 
when the state in a discrete memoryless (DM) single user 
channel is known non-causally to the transmitter [10], [11]. 
In the all-Gaussian (additive noise and interference) case, this 
result, combined with a clever choice for the auxiliary variable 
translates into the Costa-coding result [12]. The capacity of 
discrete memoryless multiple-access channels is still an open 
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problem, but in the Gaussian case a result that is similar the 
Costa result is shown in [13]. 

Recently, these two classes of problems were combined in 
the study of memoryless single user channels with non-causal 
state knowledge and feedback [3]. It was shown in this work 
that there is no capacity gain from feedback, and in the all- 
Gaussian case, interference causes no loss in capacity. 

A. Our contributions 

In this work, from one point of view, we are interested in 
understanding the impact of feedback in a MAC channel with 
state, and from the other, the impact of state on a MAC channel 
with feedback. As a concrete research challenge, we focus on a 
MAC channel with state and feedback where the state variable 
is known non-causally to both the transmitters, and find a 
general achievable region and outer bound on the capacity 
region. We find this achievable region and outer bound to meet 
for a non-trivial class of channels which includes the binary 
symmetric and binary erasure channels. 

Next, we specialize our study to the case of a Gaussian 
MAC with additive interference and feedback. The achievable 
region we obtain for this scenario coincides with a simple 
outer bound on the system, and thus results in the capacity 
region. ^From this capacity characterization, we find that: 

• Feedback enhances the capacity of the MAC channel with 
state. 

• Interference when non-causally known at the transmitter 
has no impact on the capacity region of the Gaussian 2 
user MAC channel. 

Thus, our results are analogous to the Merhav-Weissman [3] 
and Costa [12] results for the single-user case. 

B. Organization 

The rest of the paper is organized as follows. In Section 
ITTI basic definitions and notation used are introduced. The 
main results of the paper for the discrete memoryless channel 
case are presented in Section |lll| The Gaussian case is 
handled in Section II VI Detailed proofs for Sections [TO] are 
presented in Section[V]and the correspondence concludes with 
Sectionsec xonclude. 

II. Notations and Preliminaries 
A. Notation 

We adopt the following notation throughout the correspon- 
dence. For matrix A, A T , A -1 denote the transpose and 
inverse of A respectively. Random variables (RVs) will be 
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noted by capital letters, while their realizations will be denoted 
by the respective lower case letters. X^ denotes the random 
vector (X m , . . . , X n ), and X™ denotes the random vector 
(Xi i, . . . ,Xi tn ). Both Xij and Xi(j) is used to denote the 
j-th random variable of a random vector Xi. E [X] denotes 
the expectation of random variable X and the correlation 
coefficient of two scaler random variable X\, X-2 is defined 
as 

E[X 1 X 2 ] 
Px t x 2 E [ XlX Tj E [X 2 XT] ' 

The alphabet of a random variable X will be designated by a 
calligraphic letter X, and that of the n-fold Cartesian power 
of X will be denoted as X n . 

X =>Y => Z 

will be used to denote the conditional independence of X and 
Z given Y. 

B. Models and definitions 

A two-user multiple access channel with random parame- 
ters [X\, X2,S, y, P(y\xi,x 2 ,s)) is a channel with two input 
alphabets X\ X 2 ; state space S, output alphabet y, and 
transition probability P(y\xi,x 2 ,s). The states s take values 
in S according to the probability mass function (PMF) P(s). It 
is assumed that the channel and the state are both memoryless, 
namely, 

n 

P(y n \x^,x2,s n ) = J] P(3H\xi,i, x a ,i,Si) 



and 



w=ii p W' 



Here we assume the state variable is noncausally known. 
Both noncausal state information and feedback are incorpo- 
rated into the channel model via the definition of a noncausal 
feedback code (Ri,R 2 , n) as follows. 

Definition 2.1: An {R 1 ,R 2 ,n) code for the MAC 
(X\ 1 X2, S, y, P(y\xi, X2, s)) with feedback and noncausal 
state information is defined by encoding functions and 
decoding functions: 

1) The encoding functions for user i are the mappings 



fi,k ■ {1, 



i = 1,2, fc = 1,2, 



.,71, 



or in other words, for the message of user i, u>i £ 
{1, 2, . . . , 2 niii }, i = 1,2, the channel input is expressed 
as 

Xi,k = f i ,k(m,y k ~ 1 ,s n ), (1) 

where s" is the noncausal state information of the whole 
block and y k ~ 1 is the perfect feedback of channel output 
up to time t — 1. 
2) The decoding functions for the receiver are the mappings 



or in other words, the decoder gives the estimates of the 
two messages W\, w 2 , w = (wi,ui2) T , 

w = g(y n ) . (2) 
We shall use the average probability of error criterion P e 
assuming that the messages (wi,W2) are drawn according to 
uniform distribution over {1, . . . , 2 nRl } x {1, . . . , 2 ,li?2 }. 

Definition 2.2: A rate pair (i?i,i?2) per channel use is 
achievable for the MAC with feedback and noncausal state 
information if there exists a sequence of (Ri,R2,n) codes 
such that P e — > as n — > 00. 

The capacity region of MAC with feedback and noncausal 
state information, Cjl^, is the closure of the set of all 
achievable rates. Cfl^ is known to be convex by time 
multiplexing of achievable rates. 



III. Main results 

Let V stand for the collection of all RVs 

(S,U,Xi,X 2 ,Vi,V 2 ,Y) while U, V u V 2 are auxiliary 
variables introduced to form a Markov chain 

S => U => {(Xt, Vx), (X 2 , V 2 )) => Y . 

Define IZf 1 ^ to be the set of all rate pairs (R 1 ,R 2 ) such 
that 



ill 



Ri < 7(X i; Y|X 2 ,C/,5) 
R 2 < I{X 2 ;Y\X 1: U,S) 
i? 2 < I(Vx,V 2 ;Y)-I(Vi,V 2 ;S) 



(3) 



with joint distribution P(u\s)P(vi,xi\u,s)P(v2,x 2 \u,s). As 
stated in the next theorem, the set lZf IAC is an inner bound 
on the capacity region Cjl^ . 

Theorem 3.1: The capacity region of the MAC channel 
(Xi,X 2 ,S,y, P(y\xi,x 2 ,s)), with feedback and noncausal 
state information at both encoders, satisfies 



K 



MAC 



C C 



MAC 
fb,nc ' 



g-.y n ^{l,...,2 nKl } x {1, 



•>nR: 



}, 



In this achievable region, the auxiliary variable "U" reflects 
the amount of common information shared between the two 
transmitters, while "V" is the auxiliary variable associated 
with the message from Transmitter i. This expression is 
highly intuitive - the sum rate expression in (|3j resembles 
a generalized Gel'fand-Pinsker expression where there is non- 
causal side information at the transmitters and no information 
at the receivers; while the two individual constraints reflect 
the scenario where both the transmitter and the receiver know 
the channel state. 

A proof of this is given in Section lV-AI This proof builds on 
the Cover- Leung [14] and Gel'fand-Pinsker arguments [10]. It 
differs from them in the following ways: 

i) binning is used to determine common transmission (U), 

ii) backward decoding is employed at the receiver; and 

iii) sequences u" and v 2 are not placed in separate bins at 
each transmitter. 

All three changes are introduced both to facilitate the result 
and as simplifying mechanisms to make the proof tractable. 
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The outer bound is stated next. Define TZ^ IAC to be the set 
of all rate pairs (Ri, R2) such that 

Ri < I(Vt]Y\V 2 )-I{Vi',S\V2) 
R2 < /(F 2 ;y|Vi)-/(F 2 ;S|yi) (4) 
R1+R2 < I(Vi,V 2 ',Y)-I(Vi;V 2 ',S) 

for all joint distribution P(v\, v 2 ,x%, x 2 \s). 

Theorem 3.2: The capacity region of the MAC channel 
(Xx,X 2 ,S, y, P(y\x±,x 2 ,s)), with feedback and noncausal 
state information at both encoders, satisfies 

pMAC r- ■tj MAC 
u fb,nc i= /c o 

This outer bound expression is quiet intuitive. As V\,V 2 
represent the messages from Transmitters 1 and 2, the region 
resembles a combination of the multiple access capacity 
region combined with a generalization of the Gel'fand-Pinsker 
expression. In that spirit, the proof for this outer bound is an 
extension of the Gel'fand-Pinsker arguments [10] with one 
important modification. For the proof and the modification 
to the Gel'fand-Pinsker argument, see Section IV-Bl with one 
important modification. For the proof and the modification to 
the Gel'fand-Pinsker argument, see Section IV-BI 

Although the achievable region and outer bounds do not 
meet in general, one can determine non-trivial sufficient con- 
ditions for them to do so. Consider the class of MAC channels 
(called class T) that satisfy either 

H(X 1 \S,X 2 ,Y) = or H{X 2 \S 7 X 1 ,Y) = . (5) 

Theorem 3.3: The capacity region of a MAC channel in 
class r, (X\, X 2 , S, y, P(y\x\,x 2 , s)), with feedback and non- 
causal state information at both encoders, is given by 

,MAC 



nMAC 



The proof of Theorem I3.3l is provided in Section IV-CI The 
key idea is to use the condition in (|5} to prove a tighter outer 
bound for the class channels belonging to T. 

The condition in covers a wide class of discrete mem- 
oryless MAC channels. For the input sets and state set X\ = 
X 2 = S = {0, 1}, both the binary MAC adder channel, 

Y = {X 1 +X 2 + S)mod2, y = {0,l}, 

and the MAC "erasure-type" channel, 



Y 



(X 1 +X 2 + S)mod3, y = {0,1,2}, 

satisfy thus the capacity region can be characterized using 
Theorem 13.31 

On the other hand, the Gaussian MAC channel does not 
belong to class T thus Theorem 13.31 does not apply. In the 
next section, we will develop a coding strategy tailored to 
the Gaussian MAC channel. This coding scheme builds on 
Ozarow's feedback coding scheme [2] and the dirty paper 
coding strategy by Costa [12] to obtain the full capacity region. 

IV. The capacity region of the Gaussian MAC 

CHANNEL WITH RANDOM PARAMETERS 

Consider the Gaussian multiple access channel 

Y(k) = X^k) + X 2 (k) + S(k) + Z(k) , 



where {S(k)} denotes the interfering signal, which are i.i.d. 
Gaussian random variables with ES(fc) = and <t| = 
E S 2 (k) < 00. It is assumed to be known to the encoder non- 
causally. Z(k) in this model is zero-mean, white Gaussian 
noise with variance a 2 z . The average powers for the two 
transmitters are assumed to be Pi, P 2 respectively. 

One of the first results for this class of channels is in [3], 
where Merhav and Weissman show feedback does not increase 
the capacity of the point-to-point version of this channel, but 
one can significantly reduce the coding complexity and achieve 
doubly exponential error exponent by using an extension of the 
Schalkwijk-Kailath (SK) [1] coding scheme. 

In this section, we will show for the Gaussian MAC 
channel with feedback and noncausal state information at the 
transmitters, the capacity is as if the interference were absent, 
with a double exponential decay in probability of error. 

The coding scheme we employ to show our results is a 
mixture of two different schemes - the Ozarow coding scheme 
[2] and the Merhav-Weissman scheme [3]; each one of which 
is a generalization of the original Schalkwijk-Kailath coding 
scheme. 

A. Coding Scheme that achieves sum capacity 

We use the following notation in this subsection: k is the 
time index, i is the transmitter index (denoted by Tj). The 
main idea of this scheme is to set an initial condition, and over 
time send corrections (innovations) to the receiver to allow the 
receiver to converge to this initial condition. Here is the coding 
scheme: 

Before transmission. Given a message for transmitter Ti, 

rrii, mi G {0,1,..., M, — 1}, Mj = 2 nRi , map nij to a 
point on the real line as follows: 9® = (mi + 1/2) /Mi. 
Define = (— l) l ~ 1 2 Ri . Given the noncausal state S" = 
(S(l), . . . , S(n)), compute a precancelling message 8i(k) for 
k = 2, . . . , n, as 



i(p) = 0i + 



■A kS{p) 
j= P +i a i 



where p £ {2, . . . , n} and U is a scaling factor that will be 
presented later in this section. 

Initialization. This is what we call the first two transmis- 
sions (k = 1,2). At time k = 1, T 2 sends nothing while Xi 
sends 

Xi(l) = x (2)-S(l). 

The receiver obtains Yi = Xi(l)+S(Vj+Z(l) = 9 1 (2)+Z(1) 
and receiver finds an initial estimate (81) for 6® to be 9\(\) = 
Y(l). At time k = 2, T\ sends nothing while T 2 sends 

X 2 (2) = 6 2 (2) - S(2) . 

Then receiver sets its initial estimate for 9® to be 

§ 2 (2)=Y(2)=6 2 (2)+Z(2). 

Estimation recursion. This is the remainder of the trans- 
missions k = 3, . . . , n. Defining e(k) = 9,(^-9^). At time 
k, Ti transmits a scaled version of e^: 



X t {k) = a k l - 2 e l {k-l) 



(6) 
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(7) 



At the end of time k, the receiver updates its estimate of 
message 6® as: 

6 i (k)=6 i (k-l)-a^ k - 2 h i Y(k), 
while Transmitter Ti updates &j as 

e,(fc) = 6i{k) - 9i{k) 

= {e i {k-i)-e i {k-i)) + 1 ^- 

_ hjX^k) + X 2 (k) + S(k) + Z{k)) 

„k-2 



= £<(*;- 1) - 



h(X 1 (k) + X 2 (k) + Z(k)) 



k-2 



Analysis 

The estimation error at the receiver for Ti at the end of the 
kth transmission, denoted ii(k) is 

h{k) = 6{k) - 0° = ei(ft) + (6i(k) - 0?) . 

At the end of the block k = n, 0j(n) = 6® thus ?j(n) = 
£i(n). As long as ej(n) goes to zero as n — > oo, the estimation 
error at the receiver goes to zero also. 

We denote V = Xi+A" 2 + Z. Notice that all the steps taken 
above were linear. We can combine them into one system 
equation as: 



X(k + 1) = AX(k) - LY'(k) . 



(8) 



where 

X=[Xi,X 2 ] T , A = diag(oi,a 2 )) L — [aih, a 2 l 2 ] T . 

Along the lines of [2] and [6], we chose the optimal L that 
minimizes the mean squared error as: 

E[Y'(k)X(k)] 
[ ' ~ E[Y'{k) 2 } ' 

Denoting Q = E[X(k)X T (k)}, we obtain 

Q(k+1) = A[Q(k)-Q(k)H T (HQ(k)H T +a 2 z y 1 HQ(k)]A , 

from © where H = [1 1] and Y' = HX + Z. Since 
(H, A) is detectable, the matrix recursion above converges and 
Q(k) — > Q as k goes to oo, satisfying 



Q = A[Q- QH T (HQH T + a 2 z y 1 HQ]A. 



(9) 



From l|9), we solve for Q in terms of ai and a 2 z . Note that the 
diagonal elements of Q are the individual power constraints 
Pi, and the off-diagonal element is the correlation between the 
transmit signals p. These turn out to be: l|9}, 



Pi = 



Po 



(al-l)(\ ai a 2 \ + l) 2 2 



(Kl 



2 

2 

~Z i 



|a 2 

(a|-l)(|aia 2 | + l) 



(10) 

(ID 



(l«l| + l«2|) 2 

and the correlation coefficient p between Xi and X 2 satisfies, 



(a? - 1)(«1 - 1) 



(KIM 



(12) 



One can find the achievable rate (R 1; R 2 ) in terms of the 
power constraints (P 1; P 2 ) and p by rewriting the equations 
above as: 



Ri 



R2 ^ log(l+ ^); 



n i, ^ , p 1 +p 2 + 2 P yp^ 

^2 = 77 !0g 1 + 2 

2 V ai, 



(13) 



It is well-known that dl 31 is the sum-capacity point for 
the normal two-user Gaussian MAC with feedback, which is 
certainly the outer bound of the counterpart with state variable. 
Thus Jl 3I > is the also the sum-capacity for Gaussian MAC with 
feedback and noncausal state. 

Remark 4.1: Note that this precancellation strategy requires 
non-causal knowledge of the interference at both transmitters 
and causal may not be sufficient. Also note that the receiver 
updates the estimates as if there is no interference and by the 
end of the block, and due to the pre-cancelation, the estimation 
errors are not affected by the state. 

Remark 4.2: Note E[A"i(l) 2 ] < oo and E[X 2 (2) 2 ] < oo, 
due to the average power constraint, as long as the power 
assumption at the initialization stage is finite, the average 
power is asymptotically close to Pi as n — ► oo. Moreover, 
{S(k)} is not restricted to be Gaussian to achieve sum- 
capacity J 1 31 . All that is required is er 2 , < oo. 

Remark 4.3: Using the same type of pre-canceling, one can 
extend the coding scheme to Gaussian broadcast (BC) channel 
and Gaussian interference channel [4] and [6]. 

B. Hybrid coding that achieve other points in the capacity 
region 

In the previous section, we focus on sum-capacity Jl 31 . In 
this section, we combine the coding scheme in Subsection 
HV-Al with dirty-paper coding (Costa coding) to obtain the full 
capacity region. The strategy here mimics the approach used 
in [2] with an important difference - instead of superposition 
coding, we employ dirty paper coding. 

Let one transmitter, say Ti, have two messages which we 
call rrii an( l TO i 2 ' ) at ra t es R^ and R^ respectively. Given 
the noncausal state S n , let T\ use power oPi, (0 < a < 1) 

(2) - - 

to transmit m) and use the remainder aP\ (a = 1 — a) to 



transmit m^. m\~' is transmitted using the feedback coding 
scheme described in Subsection IIV-AI while 



,(2) 



is sent 



independently. Meanwhile, T 2 uses all his power to transmit 
m 2 using the feedback coding scheme in Subsection IIV-AI 
Decoding: at the receiver, messages m, 1 ^ and m 2 are first 

(2) 

decoded by treating the code letters of m\ as noise. Finally, 
mj 2 ^ is decoded. 

According to dl3> . m^ 1 ' and m 2 will be transmitted reliably 



iff 



(14) 



(15) 
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where p satisfies 

aP^l-p 2 ) 



V. Proofs 



1 



p2(i-p 2 : 

ai + aP, 



= 1 



aPi +P 2 + 2py/aP 1 P 2 \ 



aPi 



(16) 



At the end of the block, after decoding m\ and rri2, one can, 
with high probability, subtract the feedback coding from the 
channel output and obtain Y n , where 



Y n = X?(m (2) )+S n + Z n 



(2) 

Here X™(m\ ) denotes the dirty paper coded transmit vector 
corresponding to message m[ 2 \ Then can be decoded 
reliably at rate 



4 2) <^iog( 



aPi 



(17) 



By adding dl4> and dl7> . we obtain the total rate for T\ as: 



<^log 



(2) 



(1 - ap^P, 



Using d!6t and d!5> . we can obtain 



R 2 < - log 



iPi +P 2 + 2p^/ET\P2 



aPi 



ct| + Pi + P 2 + 2p^/M\P2 



a% + (1 - ap 2 )Pi 



Note by defining p' = y/ap, \p'\ < 1 and for any < p' < p, 



Ri < 2 lo S 



i? 2 < - loe 



(1 - p' 2 )Pi 



a 2 z +P 1 +P 2 + y^JPTPi 



4 + (i - P v)p x 



is achievable. A similar region can be obtained when T 2 splits 
the power to combine feedback coding and dirty paper coding. 
Thus the achievable region can be written as 

(J {(^i?2):0<i?i<^log[l+ (1 ~J 2)Pl ] 



0<p<l 



< Pi + P 2 < g l0 g|l ^2 



]}• (18) 



Note i ll 8t is the same as the capacity region of Gaussian MAC 
with feedback but without interference [2], which is clearly 
the outer bound of the channel with interference, thus (II 81 is 
also the capacity region of Gaussian MAC with feedback and 
noncausal interference, Cj^'^ c . 



A. Proof of Theorem 15.71 

Here we provide a proof for Theorem 13.11 the achievability 
of Q. 

Code Generation: 2 nRa strongly typical sequences ~ 
p(u n \s n ) are first generated. At transmitter i, for each se- 
quence u n (j),j G {1, . . . , 2 nR °}, 2 nRi V" sequences are 
generated using p(u™|w n ,s") and are indexed using k G 
{1, . . . , 2" J?1 } and I G {1, . . . , 2 nR2 } respectively. 

The index pairs (k, I) are thrown uniformly into 2 nR ° bins 
such that each bin receives 2 n ^ Rl+R ' 2 ~ Ra ^ of them. These bins 
are indexed by j, j G {1, . . . , 2 nR °}. 

A total of B (B large) messages are sent over blocks of 
length n each. At the beginning of block b, each transmitter 
successfully decoders the other transmitter's message sent in 
block 6 — 1, while the receiver waits till the end of transmission 
to decode all messages. Using shared information from block 
6—1, the transmitters cooperatively transmit "cloud centers" 
u n (j) in block b. This process is diagrammatically illustrated 
in Figure 

Encoding: Suppose j*(b) G {1, . . . , 2 nRo } is the common 
index to be sent by the two transmitters in block b. Let k*(b) 
be the message to be transmitted by Transmitter 1 and l*(b) 
that by Transmitter 2. Transmitter 1 locates v™(k*(b)) given 
the particular u n (j*(b)) and s n (b), then determines a sequence 
x\ that is jointly typical with the pair u™, s™ and transmits it. 

Similarly, Transmitter 2 locates i>2 ('*(&)) mat i s jointly 
typical with u n (k*(b)),s n (b), then generates a sequence xV^ 
that is jointly typical with this particular v 2 and s n , x" and 
x 2 are transmitted in block b. 

Decoding: We employ backward decoding at the receiver, 
i.e., we wait till all B+l transmissions are complete before we 
begin decoding. Each transmitter, however, decodes the other 
transmitter's message at the end of each block. 

Decoding at Transmitter 1: Transmitter 1 
looks for a unique index 1(b) such that the set 
(x?(k*(b)),v%(l), u n (j*(b)),s n (b), y n (b)) are jointly typical. 
Note here that x1(k*(b)),u n (j*(b)),s n (b) are all known at 
transmitter 1, and so 1(b) can be determined uniquely iff 



R 2 < I(X 2 ;Y\X U U,S) 



(19) 



Now, j*(b + 1) at Transmitter 1 is determined as the bin 
index in which the pair k*(b), 1(b) lie. 

Decoding at Transmitter 2: Similarly, Transmitter 2 can de- 
termine the unique bin index corresponding to Transmitter l's 
message if Pi < I(X 1 ;Y\X 2 , U, S). j 2 (b + 1) is determined 
as the bin index to which the pair k*(b), 1(b) belong. 

For n large, with high probability we have j* (b + 1) = 

Ja(6 + 1) =J*(6 + 1). 

Backward decoding at receiver: In block B + l only the 
common "cloud center" u n (j*(B + 1)) is communicated at a 
rate of P < I(U; Y). Using j*(B + 1) as the bin index, the 
subset of all possible choices for k(B),l(B) are determined. 
We call this subset Sb ■ Note that the cardinality of Sb is 

In block P, the cloud center u n (j(B)) is first determined, 
which can be performed at a rate Pq < I(U ; Y). Next, the 
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^ f"(f (1)) 

/ * X 

y 2 "(/*(2)) / 


/ \ - 

V?(i*(3)) 




U n {f{B)) 


' U n (j'(B + l)) 


Decoding 


V»(fc«(l)) 


vr(k'{2)) 


VT(fc*(3)) 




y™(fc*(s)) 




Receiver 


Decoding 


Vi B (fc*(l))>< 

(*•(!)) 


VT(fc*(2)) x 

y 2 "(fe*(2)) 


U n (j* (3)) 
1 < 

- ^r(fe*(3)) 

V?(fc*(3)) 




f"(i*(B)l 
V"(k*(B)) 

y 2 "(fc*(s)) 


^ U n (j'(B + l)) 



Fig. 1. The Modified Cover-Leung Coding Procedure 



The outer bound given in @ is proved here. 



unique pair of indices k(B), 1(B) in the set Sb are located, if B. Proof of the outer bound of (|4} 
they exist, such that (u n (j(B)),v^(k(B)),v^{l(B)),y n ) are 
all jointly typical. 

The set of possible errors determines the bound on the pair 
Rx, R 2 . Here we ignore trivial error cases and concentrate on 
those that provide bounds on rates. Specifically, the event 



E m , = {(u n (j(B)),v?(k'),v2(l%y n ) e T?\ 

is of concern when either k' ^ k*(B) or V ^ l*(B). 
So 



Pe = P{ (J E VV ) 

k'j^k* (B),l'jil* (B),(k' ,l')eS(B) 
2"(R 1 +R 2 -R a ) 



< 



i=2 

< 2 n ^+ R 2~ R a)2~ n ( I ( v i' V 2;Y\U)-I(V 1 ,V 2 ;S)-6e) 



Thus it is sufficient if 

Ri + R 2 - Ro < I(V U V 2 ;Y\U) - I(V U V 2 ; S). 

Proof of J20I . By Bayes' rule 



nRx = H(Wi) < I(W x \Y n ) 
< I(W i; Y n \W 2 ) 
= J2 I (Wi;Y i \W 2 ,Y i - 1 ) 



i 

Y^ns^nw^Y 1 - 1 ^) 

i 
i 

+ I(S? +1 ;Y l \W 2 ,Y*- 1 ) 

- IiS^Y^Y'-^Wx)) 



(20) 
(21) 



(22) 



(23) 



p(p \ _ P({(«"(j(B)),<(fc , ),^(i , ),a")eT c ",K(fc'),^(i'), a ")gT."}) 
^{Uk'l') - P({WC).»J(l'],«")^}) 

< 2-n{I(Vi,V 2 ;Y\U)-3e) / 2 -n(.r(Vi;V2;.S)+3e) 



Thus we have the result. 



Here, J20t results from Fano's inequality (ne„ is dropped as a 
convenience) [15], ( 12 II from the fact that conditioning reduces 
entropy, J22I T) and J23l > from the chain rule [15]. 

Note by the property of mutual information in [16] and the 
fact that Si is independent of W\, W 2 and S™ +1 , we have 



i 

= Y,i(S i ;Y i - 1 \W 2 ,S? +1 ) 

i 
i 

Y^m + i;Yi\WuW 2l Y^) 

i 

= Y,m;Y i - 1 \W 1 ,W2,S? +1 ) 

i 

= J2 I (Wi,W 2 ,S? +1 ,Y i - 1 ;S i ). 
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By defining the auxiliary variables V\, V 2 as 



we have that 



V 1 , i = {W u Y^\S^ +1 ) 
V 2 , i = (W 3f Y i -\S^ 1 ) 



(24) 



Then for R±, we have 

nRi = H(Wi) = H(Wi\W 2 ,S n ) 
<I{WuY n \W 2l S n ) 

n 

= Y, I (Wi;Y k \W 2 ,S n ,Y k - 1 ) 

k=l 



(26) 



1R1 < Y^inWuYi^Y^^^+IiW^Sf^Y^^i 

i 

-I(Wi,W2,Sb 1 ,Y i - 1 ;S i )) 
= 2(1(^5^1^,0 - I(Wr, S.^-\s: +1 ,W 2 )) 

i 



In the same way, one can obtain the inequality for R 2 . For 
the sum rate, we follow the Gel'fand-Pinsker arguments [10] 
almost exactly: 



n(R 1 +R 2 ) = H(W 1 ,W 2 ) 

< I(W u W 2 ;Y n ) 

< J^HWuW^Y^-Yi) 

i 

= J2(l(W 1 ,W 2 ,Y i -\S? +1 ;Y i ) 

i 

-Iffl+^YilYt-^WuWi)) 

i 

-I(Y l ~ 1 ;S l \W 1 ,W 2 ,S? +1 )) 

= JLi 1 ^ V ^ Y i) - HVi^V^; Si)) . 



C. Proof of Theorem \3.3\ 



The achievability is the same as the proof of the general 
achievable region in Theorem 13. II 

Now we prove Q is also the outer bound. Without any loss 
of generality, we may assume H(Xi\X 2 , S, Y) = 0, or there 
exists deterministic functions F k , such that, 



= Y,(H(Y k \W 2 ,S n ) Y k - 1 ,Xt 1 ,Xl) 
fc=i 

- H(Y k \W u W 2 ,S n , Y k ~\X k , X k )) (27) 

n 

<Y,{H{Y k \S n ,Y k -\X k -\X 2 , k ) 

k=l 

- H{Y k \X k -\Y k -\S n , X hk ,X 2 . k )) (28) 

n 

= Y,I(Xi, k ;Y k \S n ,Y k - 1 ,X k -\X 2:k ) 



k=l 



= ^I(X hk ;Y k \S k ,X 2 , k ,U k ), 

k=l 

where the auxiliary variables U k are defined as 

U k = {Y k -\X k -\S k -\S% +x ). 

Thus for R 2 , 

nR 2 = H(W 2 ) = H(W 2 \W u S n ) 
<I{W 2 -Y n \W u S n ) 



(29) 



= Y, I (W 2 ;Y k \W 1 ,S n ,Y k - 1 ) 
fc=i 

n 

= Y,{H(Y k \W 1 ,S n ,Y k ~\X k ) 

k=l 

-H{Y k \W u W 2 ,S n ,Y k - r ,X k ,X k )) (30) 

n 

< J2( H ( Y ^\S n ,Y k -\X k -\X 1 . k ) 

k=l 

-H(Y k \S n ,Y k -\X 1}k ,X 2 , k )) (31) 

n 

= Y / I (Y k ;X 2 . k \u k ,S k ,x hk ). 



fe=i 



X lik = F k (X 2 , k ,S n ,Y k ) 



(25) 



Note J26t and ( I29t are due to Fano's inequality [15]. ( I27t 
and POt are from d25i and the fact that the channel input 
Xi = Gi{Wi,S n ,Y) for feedback coding. $23 and (EJ are 
because 

{Wi, W 2 , Y k ~\ X k ~\ Xt 1 ) => {X ltk ,X 2 , k , S k ) => Y k 

forms a Markov chain. Now define the auxiliary variables Vi k , 
V 2 ,k as J24> and note given U k , V\ k and V 2k are independent, 
thus the proof for the sum-rate in theorem [3. 21 can be applied 
directly to establish 0. 

VI. Conclusions 

In this paper, both the discrete memoryless and the Gaussian 
two-user multiple access channel with state and feedback are 
analyzed, where the state is non-causally known at the trans- 
mitters. For the discrete memoryless case, both an outer bound 



and an achievable region are derived, and sufficient conditions 
under which they meet are obtained. For the all-Gaussian 
case, the entire capacity region can be found. This capacity 
region is the same as that of a Gaussian MAC with feedback 
with channel state known to the transmitters and the receiver. 
The proofs in this paper are obtained as generalizations of 
the Merhav-Weissman, Ozarow, Costa, Gel'fand-Pinsker and 
Cover-Leung coding schemes. 
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